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ABSTRACT 


A  systems  design  study  of  a  digital  correlator  for  wave¬ 
form  recognition  purposes  has  produced  a  design  that  is  prac¬ 
tical  for  hardware  implementation  of  waveform  classification 
as  outlined  in  the  original  contract.  Two  approaches  to  the 
correlation  problem,  referred  to  as  the  sum-of -products  and 
the  least-squared-difference  methods,  were  investigated.  With 
appropriate  normalization  the  sum-of-products  method  and  the 
least-squared-difference  method  can  both  be  used  for  target 
classification.  The  latter  method  has  the  following  advantages 
over  the  former: 

a)  more  economical  to  implement 

b)  less  time  required  to  identify  a  given  return 

c)  compensation  for  changes  in  the  noise  level  and 
for  certain  a  priori  information 

d)  analytical  justification 

Comparisons  are  made  of  several  designs  based  upon  .the  different 
parameters . 

Because  of  the  uniqueness  of  the  method  proposed  for  class¬ 
ification,  and  the  uncertainty  of  the  data  available  in  the  sonar 
returns,  a  simulation  study  using  recorded  sonar  returns  is  re¬ 
commended.  The  simulation  study  will  determine  the  validity  and 
accuracy  of  the  correlation  process.  It  also  will  aid  in  the 
selection  of  various  parameters  that  will  lead  to  final  systems 
design. 
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DIGITAL  CORRELATOR  STUDY 


PART  I 

A.  PURPOSE: 

The  study  was  to  conduct  a  systems  analysis  and  prepare 
a  proposed  design  of  a  digital  correlator  for  waveform  class¬ 
ification  purposes  based  on  the  following  system  parameters: 

1.  Maximum  signal  frequency  of  interest:  400  cps 

2.  Signal  amplitude  resolution:  32  levels 

3.  Range  gate:  target  range  +  1000  yards 

4.  Pulse  repetition  intervals:  8-25  seconds 

5.  Pulse  width:  10  milliseconds  to  1  second 
On-line  classification  was  to  be  given  priority  over  off-line 
procedures,  and  various  designs  were  to  be  investigated  with 
comparisons  made  for  each  system. 


B.  GENERAL  FACTUAL  DATA: 

Personnel ;  The  following  personnel  were  employed 
for  the  periods  indicated. 

R.  B.  Arndt,  Principal  Systems  Design  Engineer: 

G.  F.  Marette,  Principal  Systems  Design  Engineer: 
E.  J.  Farrell,  Mathematician: 

R.  R.  Lachenmayer,  Associate  Systems  Design  Eng: 


in  this  study 

1.5  man  months 
4.0  man  months 

4.7  man  months 

5.8  man  months 
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DETAILED  FACTUAL  DATA: 


1.  Algorithm  Determination.  The  initial  approach  to  the 
correlation  problem  was  based  on  the  generation  of  a  sum-of- 
products  correlation  between  the  range-gated  unknown  waveform 
and  a  library  of  standard  waveforms.  The  correlator  design  was 
to  be  based  on  the  availability  of  an  AN/USQ-20  Unit  Computer 
during  the  time  required  for  the  classification  procedure. 

Several  methods  were  considered  for  implementing  the  sum-of- 
products  computation,  but  because  of  the  stringent  time  require¬ 
ments  of  the  on-line  problem  these  methods  were  narrowed  down  to 
two:  residue  arithmetic  and  carry-store  addition.  The  residue 
arithmetic  was  attractive  because  of  the  fast  multiply  and  add 
times  available  in  this  system.  These  fast  times  result  because 
there  is  no  propagation  of  carries  or  borrows  between  residue 
groups.  Disadvantages  of  the  residue  system  are  the  conversions 
required  between  residue  and  binary  representation  at  the  input 
and  output,  and  there  is  no  practical  method  for  comparing  two 
residue  numbers.  This  was  particularly  important  since  classifi¬ 
cation  would  be  determined  by  the  maximum  correlation  values 
computed. 

The  second  method,  the  carry-store  addition,  was  selected 
for  use  because  it  did  not  have  the  conversion  and  comparison 
limitations  of  the  residue  system,  and  could  be  operated  at  fast 
speeds  for  the  size  of  the  numbers  involved.  In  this  method  the 
products  are  accumulated  by  a  series  of  half  adds,  where  the 
carries  are  stored,  and  are  not  allowed  to  propagate  more  than 


3 


one  stage  for  each  half  add.  At  the  end  of  the  last  product 
addition,  the  carries  are  allowed  to  propagate  through  the  carry- 
pyramid  to  obtain  the  final  sum-of-products .  The  amount  of  extra 
time  re-quired  for  the  final  propagation  of  carries  is  not  sig¬ 
nificant  and  therefore  the  total  multiply-add  time  is  essentially 
the  time  required  to  do  the  half  adds. 

In  most  digital  multipliers,  the  multiplier  is  examined  one 
bit  at  a  time  and  the  multiplicand  or  zero  is  added  to  the  ac¬ 
cumulated  product,  if  the  multiplier  bit  being  sampled  is  a 
binary  "1"  or  "0",  respectively.  The  multiplicand  must  be  scaled 
by  powers  of  two  depending  upon  the  location  of  the  "1"  within 
the  multiplier  word.  If  this  method  were  used,  it  would  take 
five  half  add  times  to  complete  each  sample  by  sample  multipli¬ 
cation.  This  time  would  be  excessive  for  the  problem  under 
study,  so  it  was  decided  to  examine  the  multiplier  in  two  incre¬ 
ments  instead  of  five.  The  first  sampling  of  the  multiplier 
examines  the  lower  3  bits  and  the  second  sampling  examines  the 
upper  two  bits  and  the  carries  from  low  order  bits.  Monthly 
Status  Report  #3  presents  a  detailed  description  and  example  of 
this  multiplication  procedure.  The  end  result  of  this  scheme  is 
that  it  allows  the  multiplications  for  5-bit  samples  to  be  com¬ 
pleted  in  two  half  add  times  instead  of  five. 

2.  Timing  Considerations .  With  the  multiplication  scheme 
selected,  the  system  parameters  affecting  speed  were  examined 
to  determine  a  practical  clock  rate.  The  factors  affecting  this 
were:  the  maximum  pulse  repetition  rate  of  8  sec.,  the  length 
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of  the  standard  reference  waveforms,  the  sampling  frequency, 
and  the  number  of  stored  reference  waveforms.  The  first  calcula¬ 
tion  assumed  the  number  of  stored  reference  waveforms  to  be  1000. 
The  number  of  5-bit  multiplies  and  the  time  per  multiply  were 
plotted  as  a  function  of  sampling  frequency  and  standard  wave¬ 
form  size.  These  results  are  shown  in  Figures  !•  and  2,  res¬ 
pectively.  From  Figure  1  it  can  be  seen  that  for  a  sampling 
frequency  of  800  cps.  and  a  standard  waveform  length  of  150 

g 

yards,  there  would  be  277  x  10  5-bit  multiplications  in  8  sec¬ 
onds.  Figure  2  shows  that  this  would  allow  a  maximum  of  30 
nanoseconds  per  multiply  or  15  nanoseconds  per  half  add  which 
is  impractical  in  terms  of  the  present  state  of  the  computer 
art. 

In  view  of  the  above,  it  was  decided  to  utilize  circuitry, 
developed  for  Project  Lightning,  operating  with  a  four-phase, 

4  -megacycle  clock  that  results  in  a  16-megacycle  transfer  rate. 
With  the  clock  rate  thus  fixed,  another  series  of  calculations 
were  run  to  determine  the  number  of  standard  waveforms  that  could 
be  referenced  as  a  function  of  sampling  frequency  and  standard 
waveform  size.'  The  results  of  these  calculations  are  shown 
in  Figure  3.  From  this  graph  one  can  see  the  various  trade-offs 
possible  at  different  sampling  rates  for  the  standard  waveform 
sizes  shown.  For  example,  for  a  sampling  frequency  of  800  cps 
and  standard  waveform  size  of  150  yards,  there  is  time  to  per¬ 
form  a  sum-of-products  correlation  with  115  standard  waveforms 
in  8  seconds.  At  a  sampling  frequency  of  400  cps  and  the  same 
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standard  waveform  size,  the  number  of  waveforms  increases  to 
462.  Also,  as  the  size  of  the  standard  waveform  is  reduced, 
the  number  of  standard  waveforms  increases. 

3.  Sum  of  Products  System. 

(a)  System  Description 

Since  these  results  indicated  that  the  assumed 
clock  rate  could  be  used  to  correlate  over  a  large  number  of 
standard  waveforms  for  different  trade-offs  of  sampling  fre¬ 
quency  and  standard  waveform  lengths,  a  feasibility  design 
utilizing  the  AN/USQ-20  Unit  Computer  was  completed  to  determine 
the  approximate  number  of  circuits  that  would  be  required  to 
implement  a  correlator.  This  design  used  the  sum -of -products 
method  of  which  a  block  diagram  is  shown  in  Figure  4. 

In  reference  to  Figure  4,  the  standard  waveform  is  stored 
during  correlation  in  registers  Rq  thru  Rg.  Registers  Rg  and 
R^  are  used  to  shift  the  standard  waveform  by  the  sample  size 
in  a  circular  manner  in  conjunction  with  the  other  R  registers. 
The  quantized  range  gate  samples  are  held  in  registers  Gq  thru 
Gg .  Registers  Gg  and  G^  are  used  to  shift  the  range  gate  in¬ 
formation  in  much  the  same  manner  as  registers  Rg  and  R^  shift 
the  standard  waveform  samples.  Since  the  range  gate  information 
is  correlated  at  one-sample  offsets,  another  holding  register 
is  provided  to  supply  the  additional  sample  required  for 
each  offset. 
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The  lower  five  bits  of  register  Gg  act  as  the  multiplier 
for  each  operation,  and  the  corresponding  bits  of  Rg  are  the 
multiplicand.  The  multiplier  is  examined  in  two  increments;  the 
lower  three  bits  first  and  then  the  upper  two  bits.  This  is  ac¬ 
complished  by  the  sensors  shown  in  the  block  diagram  of  Figure  4 
as  the  sensor  gates.  The  result  of  the  first  sensing  operation 
will  be  to  gate  the  appropriate  multiple  of  the  multiplicand 
through  the  Xg  gates  to  be  half  added  with  the  quantities  in  the 
$2  and  Cg  registers.  The  second  sensor  will  control  the  trans¬ 
mission  of  another  multiple  of  the  multiplicand  to  the  X,  regis¬ 
ter  where  it  will  be  half  added  with  the  quantities  in  the  Sj  and 
C|  registers.  The  Sj  ,  and  registers  contain  the  stored 

bit  sums  and  carries  resulting  from  the  half  adds. 

In  practice  each  standard  waveform ■ would  contain  a  constant 
which  would  be  a  combination  of  normalizing,  probability,  and 
■threshold  constants.  This  constant  would  be  initially  entered  in¬ 
to  the  Sg  register  by  the  transmission  path  shown  from  the 
■register  to  the  register  in  Figure  4.  At  the  completion  of  the 
multiply-add  operation  for  each  offset  of  the  range  gate  informa¬ 
tion,  the  resulting  sum  is  compared  to  the  highest  previous  cor¬ 
relation  value  obtained  for  that  specific  standard  waveform.  If 
the  resulting  sum  is  greater, • it  is  stored  in  the  H  register,  which 
holds  the  high  correlation  value. 

(b)  Control 

A  flow  chart  illustrating  the  control  ’sequence  is  shown 
in  Figures  5  and  6.  For  the  purpose  of  this  illustration,  it  will 
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be  assumed  that  all  registers  of  Figure  4  will  be  in  the  cleared 
state,  and  that  the  range  gate  and  1000  standard  waveforms  are 
stored  in  the  memory  of  the  AN/USQ-20  Unit  Computer.  The  load-' 
ing  sequence,  Figure  5,  is  initiated  by  the  sonar  operator.  On 
the  "start"  command  the  loading  of  the  first  standard  waveform 
is  begun.  As  the  loading  sequence  of  the  first  standard  wave¬ 
form  is  completed,  the  loading  of  the  range  gate  waveform  is  ini¬ 
tiated.  At  its  completion,  the  actual  correlation  process  is 
begun  as  shown  in  Figure  6  and  repeated  through  the  1000  stan¬ 
dard  waveforms,  at  which  time  the  .correlation  value  will  be  dis¬ 
played  and  the  loading  and  correlation  sequences  terminated. 

4.  Statistical  Analysis .  While  the  sum-of -products  design 
was  being  completed,  analysis  of  the  general  problem  of  wave¬ 
form  classification  was  continuing.  Reasonable  criteria  for  se¬ 
lecting  a  classification  procedure  lead  to  procedures  that  have 
the  same  general  form  and  differ  only  in  the  value  of  certain 
parameters.  A  detailed  discussion  and  derivation  is  presented 
in  the  attached  report.  Basically  the  procedures  "correlate"  the 
input  return  with  all  of  the  standard  returns,  and  select  the 
standard  return  with  the  highest  "correlation".  The  "correlation" 
value  used  to  compare  the  standard  returns  is  the  usual  product- 
sum  correlation  corrected  by  an  additive  constant.  If 
^'^ii  ’  '^iz  ’  ***’  '^in^  represents  the  i-th  standard  return,  and 
(X|  ,  Xg ,  ...,  Xj^)  represents  the  input  return,  the  optimum  pro¬ 
cedure  compares 
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etc.,  where  ^  is  the  average  (or  d.c.)  noise  level  and  77^  is  the 
average  squared  noise  level  (or  average  noise  power).  The  value 
of  the,  parameters  and  w^  depend  on  criterion  used  in  selecting 
a  classification  procedure. 

For  example,  if  the  goal  is  to  maximize  the  average  prob¬ 
ability  of  correct  classification,  w^  =  1  for  all  values  of  i  and 
is  the  relative  frequency  (or  a  priori  probability)-  that  the  in 
put  return  is  from  the  i-th  target.  Introducing  a  priori  prob¬ 
abilities  has  the  effect  of  favorably  weighting  those  standard 
returns  that  occur  more  often.  The  influence  of  this  weighting 
increases  with  the  noise  power;  if  the  noise  level  is  high,  the 
classification  procedure  relies  more  on  a  priori  probabilities 
than  on  the  input  return.  If  the  a  priori  probabilities  change 
from  one  region  of  the  ocean  to  another,  one  can  adjust  the 
classification  procedure  by  changing  the  X^'s.  Similarly,  if 
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the  noise  power  increases  due  to  changes  in  target  range  or 
position  of  the  sonar,  one  can  adjust  the  classification  pro¬ 
cedure  by  changing^.  Note  that  u^^  +  17  is  obtained  by  averaging 
several  returns  from  a  known  target. 

Several  assumptions  were  made  to  arrive  at  the  above  classi¬ 
fication  procedure:  viz., 

i)  The  range  of  the 'target  is  known, 

ii)  The  input  to  the  digital  correlator  has  been  corrected 
for  range  attenuation;  the  input  return  and  standard 
returns  have  comparable  amplitudes.  The  "signal  to 
noise"  ratio  may  change  with  range, 

iii)  The  quantized  (in  amplitude)  samples  from  the  input 

return  can  be  approximated  by  continuous  samples, 

iv)  The  noise  is  a  superposition  of  randomly  positioned 

pulses  with  random  amplitudes;  i.e.,  the  noise  is 

Gaussian. 

v)  The  noise  characteristics  are  constant  over  the  range 
gate:  constant  average,  constant  power,  etc. 

vi)  The  noise  spectrum  has  a  sharp  high  frequency  cutoff; 
and  the  sampling  frequency  is  twice  this  cutoff  fre¬ 
quency. 

In  practice,  the  exact  range  of  the  target  is  unknown  and 
the  range  gate  must  be  searched.  In  this  case,  another  term  must 

n  2 

be  added  to  the  correlation  value:  viz.,  -  2  .  In  our 

r=i 
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analysis  of  classification  with  a  known  range,  this  term  appears 
as  a  "constant"  in  comparing  the  standard  returns  and  was  dropped. 
Introducing  this  terra,  the  classification  procedure  becomes  a 
comparison  of 

_  •  n  „ 

2(77^  -  77^  )log(W|  X,  )  -  2  (u  +  77-x^)  , 

r=i 

—  n  2  • 

2(77^  -17^  )log(w  X,)  -  2  (u  )  , 

r=i 

■  n 

2{  rj  ^  -rf^  -2  (u^^  +77-x^)^,  etc. 


Basically,  this  classification  procedure  is  a  comparison  of 
the  least  squared  deviation  between  the  input  return  and  the 
various  standard  returns. 

5.  Least  Squared  Difference  Method.  Since  the  least 
squared  difference  method  appeared  attractive,  a  design  utilizing 
this  method  was  completed.  The  desired  result  of  the  least 
squared  difference  method  is 

2  (R  -  G^)  =  correlation  value 

r=i 

where  R  represents  the  quantized  amplitude  of  the  stored  reference 
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waveforms  and  G  represents  the  quantized  amplitude  of  the  raw 
video  waveform. 

Figure  7  is  a  block  diagram  of  the  correlator  implementing 
the  above  process.  Comparing  Figure  7  with  Figure  4  shows  the 
elimination  of  the  30-bit  registers  and  plus  associated 
circuitry. 

The  remaining  R  and  G  registers  continue  to  perform  the  func¬ 
tion  of  holding  the  standard  waveform  and  a  portion  of  the  range 
gate  return  during  the  correlation  process.  The  shifting  form¬ 
erly  done  between  registers  Gg  and  G^  and  between  Rg  and  R^  has 
been  eliminated.  The  same  effect  is  now  obtained  by  gating  di¬ 
rectly  out  of  the  appropriate  sections  of  Gg  and  Rg  .  The  two 

2 

blocks  labeled  (R-G)  subtract  one  five-bit  sample  in  G  from  one 
five-bit  sample  in  R,  square  the  difference,  and  then  transfer 
it  to  their  respective  Xj  or  registers.  The  S  and  G  registers 
and  the  half  adders  continue  to  perform  the  summation  process. 

The  H  register  is  used  to  store  the  current  correlation  sum  for 
comparison  with  the  latest  result. 

This  design  along  with  the  sum-of-products  design  had  the 
disadvantage  of  being  limited  by  the  input/output-  speed  of  the 
AN/USQ-20  Unit  Computer.  The  least-squared-difference  system 
was  capable  of  operating  at  twice  the  speed  of  the  sum-of-products 
system,  but  since  both  systems  were  limited  by  the  -speed  of  the 
AN/USQ-20  Unit  Computer,  the  main  advantage  of  the  least-squared- 
difference  method  was  that  slower,  less  expensive  circuits  could 
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Block  Diarjram  of  Correlator  Utilizing)  (H-G)  Process 


be  utilized  in  the  design.  Another  disadvantage  of  both  of  the 
aforementioned  designs,  was  the  need  for  holding  registers  for 
both  the  standard  waveform  and  a  portion  of  the  range  gate  wave¬ 
form.  These  registers  would  have  to  be  equal  in  length  to  the 
size  of  a  standard  waveform.  For  large  standard  waveforms,  high 
sampling  rates,  and  greater  number'  of  levels  of  quantitization, 
the  number  of  circuits  required  for  these  holding  registers  be¬ 
comes  many  times  greater  than  the  number  of  circuits  required  for 
the  arithmetic  operations.  This  can  be  seen  in  Table  I  which  is 
a  tabulation  of  the  approximate  number  of  inverters  required  to 
implement  either  of  the  two  systems  for  various  sampling  fre¬ 
quencies  and  standard  waveform  sizes.  The  numbers  in  the  columns 
labeled  R  8.  G  represent  the  inverters  required  for  the  two  holding 
registers.  The  last  column  shows  the  percentage  of  the  total  num- 
ber  of  inverters  required  for  the  holding  registers. 

6.  Separate  Memory  Systems.  In  order  to  take  advantage 
of  the  speed  of  the  least-squared-difference  method  and  to  partly 
eliminate  the  need  for  the  many  holding  registers,  a  system  de¬ 
sign  utilizing  a  separate  memory  for  the  quantized  range  gate  wave 
form  was  investigated.  A  block-diagram  of  this  system  is  shown  in 
Figure  8.  Besides  operating  at  twice  the  speed  of  the  previous 
least-squared-difference  system,  this  design  has  eliminated  most 
of  the  holding  registers  required  for  the  range  gate  waveform. 

Two  registers,  Gq  and  Gj  ,  are  required  external  to  the  memory  for 
shifting  purposes.  These  registers  are  one  sample  size  greater 
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Yards  Number  1  Number  of  Inverters 
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than  the  word  length  of  the  memory.  This  was  necessitated  to 
allow  for  one  sample  offsets  in  the  correlation  process  across 
the  range  gate  samples. 

In  the  initial  phases  of  the  study,  it  was  assumed  that  the 
AN/USQ-20  Unit  Computer  would  be  available  for  use  in  the  target 
classification  process,  and  that  memory  space  and  input/output 
channels  would  also  be  available  for  these  purposes.  Later  dis¬ 
cussions  with  Bureau  of  Ships  personnel  have  cast  some  doubt  upon  ' 
the  validity  of  these  assumptions.  Because  of  this  and  the  fact 
that  the  holding  registers  required  for  the  standard  reference 
waveforms  can  be  very  large  at  high  sampling  frequencies,  another 
system  was  studied  which  included  a  separate  memory  for  the  re¬ 
ference  waveforms.  A  block  diagram  of  this  system  is  shown  in 
Figure  9. 

This  system  is  completely  independent  of  the  ANAfSQ-20  Unit 
Computer.  The  high  values  of  correlation  are  stored  in  the  re¬ 
ference  waveform  memory  and  the  control  portion  of  the  correlator 
updates  these  values  after  each  reference  waveform  is  completed. 

A  disadvantage  of  this  system  is  that  extra  circuitry  must  be  add¬ 
ed  to  enter  reference  waveform  information  from  a  peripheral  stor¬ 
age  device  such  as  a  magnetic  tape  unit.  The  reference  waveform 
memory  would  also  have  to  be  faster  than  the  AN/USQ-20  Unit  Com¬ 
puter  memory  since  it  would  have  to  keep  pace  with  the  speed  of  the 
correlation  process.  With  a  transfer  rate  of  16  megacycles,  two 
samples  from  each  waveform  would  be  subtracted,  squared,  and  summed 
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Block  Diagram  of  Correlator  Employing 
Kange  Gate  and' Reference  Waveform  Memories 


every  1/4  psec.  Therefore  a  memory  word  length  of  6  samples  re¬ 
quires  a  new  word  to  be  read  evety  3/4  ^sec.  If  a  larger  word 
length  were  selected,  the  memory  cycle  time  would  be  increased 
proportionally. 

7.  Sonar  Recording  Observations .  A  group  of  sonar  returns 
were  made  available  by  the  Underwater  Sound  Laboratories  in  the 
last  phases  of  this  study.  Some  of  these  returns  were  recorded 
for  a  cursory  visual  inspection.  Figure  10  shows  a  submarine  re¬ 
turn  at  four  different  speeds  plus  a  representative  whale  return. 
The  filtering  evidenced  in  Figures  10a,  b,  c  and  e  is  a  result  of 
mechanical  filtering  introduced  by  the  strip  recorder.  Figure  lOd 
shows  the  800-cycle  component  from  the  AN/SQS-23  audio  channel. 

The  initial  examinations  seem  to  indicate  that  each  target 
has  a  representative  waveform  or  class  of  waveforms  that  are  not 
similar  to  the  whale  returns.  Since  none  of  the  targets  on  t  le 
tapes  were  identified  according  to  nature,  size,  or  aspect,  the 
results  could  not  be  extended  to  include  any  detailed  analysis  of 
the  observed  waveforms. 

D .  CONCLUSIONS : 

The  resulting  designs  and  study  have  shown  that  a  digital 
correlator  for  the  classification  of  sonar  waveforms  is  practical 
from  both  the  mathematical  and  hardware  viewpoints.  For  a 
sampling  frequency  of  800  cps,  a  standard  waveform  size  of  150 
samples,  and  the  maximum  pulse  repetition  rate  of  8  seconds,  it 
is  possible  to  correlate  over  200  reference  waveforms.  As  these 
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Recorded  Sonar  Returns 


, .05  sec. 


:(b)  Submarine 


parameters  are  relaxed,  it  is  possible  to  correlate  greater  num¬ 
bers  of  reference  waveforms.  The  procedures  developed  also  allow 
for  changes  in  noise  level  and  for  differences  in  the  frequency 
of  occurrence  of  various  targets. 

PART  II 

RECOMMENDATIONS 

Since  the  method  proposed  is  relatively  unique  for  the 
classification  of  sonar  returns,  there  are  several  unknowns  that 
will  affect  the  selection  of  a  specific  design.  Some  of  these 
are; 

1)  number  of  different  waveforms  needed  to  represent  a 
specific  target  (or  class  of  targets)  at  various 
aspects . 

2)  sampling  frequency  which  is  sufficient  to  identify 
different  types  of  targets 

3)  length  of  standard  reference  waveforms  necessary  to 

uniquely  identify  a  target  or  class  of  targets 

4)  number  of  levels  of  quantitization  necessary  for 
accurate  identification 

5)  number  of  sample  offsets  in  the  range  gate  waveform 
to  effect  a  correct  identification  with  the  standard 
reference  waveforms 

6)  the  availability  of  the  AN/USQ-20  Unit  Computer  for 
the  correlation  process. 
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It  is  recommended  that  the  above  areas  be  studied  further 
to  determine  the  optimum  parameters  for  a  specific  design.  A 

simulation  phase  has  been  proposed  that  will  simulate  the 
mathematical  procedures  recommended  with  actual  sonar  returns. 

The  simulation,  besides  determining  the  validity  of  the  methods 
recommended,  will  be  used  with  variations  in  the  system  para¬ 
meters  to  obtain  a  final  recommended  system  design. 

For  the  extended  study  and  simulation  the  recordings  of 
sonar  returns  must  contain  explicit  information  regarding  the 
targets.  This  will  be  necessary  for  the  formulation  Of  the  stan¬ 
dard  reference  waveforms  and  also  to  determine  the  accuracy  of 
the  simulated  correlation  process. 
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Waveform  Identification  Using, 

Digital  Techniques 

!•  Introdu<jtion 

Manjr  problems  of  waveform  identification  or  recognition 
can  be  formulated  in  the  following  way.  Several  standard  wave¬ 
forms  are  specified.  Given  one  of  the  standard . waveforms  thit 
has  been  changed  by  ’’noise**,  the  problem  is  to  identify  the 
standard  waveform.  In  many  situations  waveform  identification 
is  difficult  and  accurate  comparisons  must  be  made.  For  this 
reason  digital  techniques  are  preferred  over  analog.  ’  The  noisy 
waveform  and  standard  waveforms  are  digitized;  i.e.,  they  are 
represented  by  uniformly  space  samples.  The  noisy  waveform  is 
identified  using  these  digitized  waveforms.  In  the  following 
paragraphs  an  identification  procedure  is  derived. 
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II.  Selection  of  an  Identification  Procedure 

By  applying  certain  methods  of  decision  theory,  one  can  : 
select  an  Identification  procedure  without  additional  re-  »  -  ; 

strlctlons  on  the  problem.  There  are  several  criterion  for 
selecting  an  Identification  procedure.  The  following  criterion^'  ' 
will  be  discussed* 

1)  average  probability  of  correct  Identification, 

11)  probability  of  correct  Identification  for  "least 
favorable"  standard  waveforms, 

111)  probabilities  of  correct  Identification  which  are 
In  a  specified  ratio.  .  , 

Assume  there  are  N  standard  waveforms.  Let  Pj^(^)  be  the 
probability  of  correct  Identification  when  the  noisy  waveformT 
Is  the  1-th  standard  waveform  and  Identification  procedure  I  is 
used.  The  average  probability  of  correct  Identification  is 
N  ■ 

X^Pj^(I),  where  Xj,  represents  the  a  priori  probability  that  the 

noisy  waveform  Is  the  1-th  standard  waveform.  The  probability  of 
correct  identification  for  "least  favorable"  standard  waveforms 
is  mln{p^(I),  Pg(I)»  •••,  Pjj(I)}.  The  third  criterion  is  of  a 
different  nature.  In  certain  situations  It  may  be  desirable  to 
have  the  p^(I)*s  In  a  specified  ratio;  l.e.,  w^p^(I)  =  w^P^Cl)’* 
where  the  w^’s  are  positive.  The  goal  Is  to  select 
an  Identification  procedure  I*  that  satisfies  the  above  ratio 
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condition  and.  for  which  the're  is  nC  ’’uniformly  better”  pro¬ 
cedure;  i.e.,  there  is  no  procedure  I*,  such  that  p^(I*)  < 
for  all  i  and  p^d  )  <  some  J. 

These  criteria  lead  to  identification  procedures  that  have 

the  same  form  and  differ  only  in  the  value  of  certain  parameters.  ■ 

Let  X  =  (x  ,  X  ,  X  ,  •••,  x„)  represent  n  uniformly-spaced  samples 
1  8  8  n 

of  the  noisy  waveform.  Let  fj^(x)  represent  the  multivariate  dens¬ 
ity  function  of  x  given  the  noisy  waveform  is  .1  the  i-th  standard 
waveform.  The  optimum  identification  procedure  for  all  three 
criteria  is  of  the  form 

^if  X  is  received  and 

*  \  '^iVi^^^  *  max{  w^\^f^(x),»;*,Wjj\jjfjj(x)  }, 

V  then  select  the  i-th  standard  waveform. 

If  Wj^  **  1  for  all  i  and  is  the  a  priori  probability  that  the 
noisy  waveform  is  the  i-th  standard  waveform, ideftiflbatlcn  procedure 
maximizes  the  average  probability  of  correct  identification. 

If  *  1  for  all  i  and  if  the  Xj^’s  are  selected  so  that 

. Pn”k>> 

then  I^  maximizes  the  probability  of  correct  Identification  for 
’’least  favorable”  standard  waveforms.  For  specified  if  the 

Xj^'s  are  selected  so  that 

=  vr^P^(I^) . 

then  satisfies  the  third  criterion,  provided  the  Xj^*s  are  positive. 
These  statements  are  proven  in  the  following  paragraph. 
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An  identification' procedure' I  can  be  characterized  by  a 
collection  of  N  sets  in  Euclidian  n-space;  l.e.,  if  x  is  in 
the  first  set,  select  the  first  standard  waveform,  if  X  is  in 
the  second  set,  select  the  second  standard  waveform,  etc. 

Let  Xj^Cl,  x)  be  a  function  of  x  which  is  one  when  x  is  in  the 
i-th  set  and  zero  otherwise.  Note  that 

N 

J  X^Cljx)  «  1 
1=1 

for  all  I  and  x.  Also 

Pj^(I)  *  J  Xj^(I,x)  fj^(x)  dx, 

K 

where  the  integration  is  over  all  values  of  x.  Using  X^(I,x), 
it  is  easy  to  show  that  maximizes 

n 

Z  (I)  • 

1=1  ^  '■  •'  * 

First 

n  ■  n  .  . 

Z  (I  x)fj_(x)dx 

1*1  i*i,  * 

1*1  .  ■ 


yroffl  the  deflnitlon’bf ,  it  follows  that, 
.  n  n 


for  each  n,  and  hence  .  .  ' 

•  n  ■  n 

.  ■ .  1*1  ..  ■,  1=1 

If  the  Xj|^*a  are  selected. so  that  w^p^(Ij^)  * 
WuPjj(Ix)»  then 

min  C  w^p^dx.),  w^p^(Ij^),  ...  }  ■  w  p dx)  ■ 


Z  ^  Z  ^  ^  V  p  (i)j  w  p  (li,  ... }  . 

i«i‘  i«i 

I  .  , 

If  the  \^‘s  are  positive,  there  is  no  uniformly  better  procedure. 
Assume  there  is  a  I*  such  that 


PfClx)  i  P^CI*)  all"  1 
Pjdx)  <  Pjd*)  for  some  j, 


?  • 


then  .<  provided  the  Xj^*s  are  positive; 

but  this  Is  a  eottntradiction.  It  follows  that  Is  optimum  for 
all  three  criteria;  the  proof  Is  completed.  In  the  follodng  sec 
tloii)  It  will  he  shown  that  I^  Is  relatively  simple  with  da  us  s  Ian 

ncise. 
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III,  Identification  with  Gaussian  Noise  ■ 

Assume  the  density  function  fjCx)  Is  from  ths  exponential 
famllyj'  l.e,,  can  be  expressed  as 

,  «  .J  h(x)  exp  £  bj^x,  , 

\r=i 

where  h(x)  Is  Independent  of  j,  and  where  a^  and  are  Inde¬ 
pendent  of  X,  Note  that 


f 


since  the.  Integral  of  fj(x)  Is  one.  The  Identification  procedure 
la  a  comparison  of  w^X^f^Cx) ,  w^X^f^^Cx),  w^X^f^(x)  •  ,WjjXjjfjj(x) 

for  a  given  x.  Since  h(x)  appears  as  a  constant  factor  In  each 

expression,  Ij^  reduces  to  a  comparison  of  exp|' 

n 


w^X^a^  exp 


F  I 

r®i  / 


r=i 


),  etc.,  or  equivalently  a  comparison  of 


n  n 

®i  ^r^r’  °s  ^8r*r»  «*c.,  where  c^  «  log  w^X^a^ 
f*! 


r*i 


If  the  noise  Is  a  superposition  of  randomally  positioned  pulses 
with  random  amplitudes.  It  can  be  approximated  by  Gaussian  noise; 
fj(x)  will  be  a  multivariate  normal  density 


fj(x) 


det(fflj,g) 

(8it)« 


exp 


n  n 


2Z  ^  ^®rs^*8"“j8” 

1=18=1 


where  (m__)  la  tHe  inverse  of  the  covariance  matrix  of  the 

.noise,  where  fj  is  the  average  (or  d.c.)  noise  level,  and 

where  » *  *  •  represents  the  J-th  standard  waveform. 

The  average  noise  level  is  assumed  to  be  constant  over  the 

sampling  interval.  A  Gauisslan  approximation  is  reasonable 

when  the  average  density  of  the  noise  pulses  is  "high"  and  the 

variance  of  the  amplitudes  is  '’small”.  The  normal  density  func- 

• 

tlon  is  ^n  the  exponential  family;  the  constants  a^  and  b^r  are 


'4 


exp 


n  n 


A  fiS« 


L  r=is^ 


n 

"it  *  I 

8*1 


The  procedure  reduces  to  a  comparison  of 

■  n  n  n 

log(w  X  )  -  Z  ^“ir'"^^®rs^“is‘"^^  \r*i 
r=i s*i  r*i 


n  n  n 

2I  E  -"I 

r*i s=i  r=i 


logCw  X  ) 
8  8 


b  X,'.' 

ar  r 


,  etc, 


The  noise  Is  assumed  to  be  Gaussian  in  the  remainder  of  this 
paper. 

Assume  the  statistical  characteristics  of  the  noise  are 

I 

Independent  of  time  (l.e. ,. stationary  noise)  over  the’  sampling 
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Interval,  and  that  the  autocorrelation  of  the  noise  0(t) 

can  be  evaluated.  Then  (m^^)  is  the  inverse  of 

r  s 


where  t  is  the  time  between  samples  and  p®  is  second  moment 
(or  average  power)  of  the  noise. 

If  the  noise  spectrum  has  a  sharp  high-frequency  cutoff,  and 
if  1/t  is  twice  this  cutoff  frequency,  the  procedure  I\  takes  on 
a  simple  form.  Consider  the  noise  shifted  by  its  average  if.  If 
the  noise  has  a  spectrum  of  the  form 

0<  CD  <  co^ 

G(<d),  =  < 

[o  CO  >  cOq  , 


10 


for  k  =1,  2,  3)'***»  In  other  words,  the  covariance  matrix 
of  the  noise  is  diagonal  and  mj.g  =  t]®  -  ri®  ^rs*  ^®" 

duces  to  a  comparison  of 

r  —  ■  1  ^  ^  ■ 

log(w^X^)  -  ■"! 

r=i  r=i 


4  **  XI 

fi^  -  log(Wg\^)  -  Z 

r=i  •  r=i 
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IV.  Probability. of  Correct  Identification 

Let  be  the  set  of  such  that 

n 

{  cj  -  cj  +  s  0  }  . 

r=i 

Then  P^Cl^)  Is  the  probability  of  given  the 

noisy  waveform  Is  the  j-th  standard  waveform.  Theoretically  one 

can  evaluate  since  the  x^^'s  have  a  known  multivariate 

normal  density  function.  In  practice  It  may  be  very  difficult 

to  evaluate  p.(I.  )  for  large  N  and  n.  If  It  Is  not  practical  to 
J  A. 

■evaluate  PjCl^)  directly,  one  can  use  upper  and  lower  bounds  for 

In  analyzing  a  system  the  parameters  of  the  system  are  given 
and  Pj(I^)  tnust  be  determined.  With  a  lower  bound  for  Pj(I^)  one 
can  make  statements  like — for  the  given  parameter  values  the  average 
probability  of  correct  Identification  Is  at  least  .93»  An  upper 
bound  for  Pj(l^)  would  be  of  little  help  In  analyzing  a  given 
system.  An  upper  bound  Is  more  helpful  In  design  than.  In  analysis. 
In  design,  p^(I^)  Is  specified  and  the  system  parameters  must  be  de¬ 
termined.  With  an  upperbound  for  p^d^)  one  can  make  statements 
like — to  achieve  the  specified  value  of  Pj(I^)  one.  must  take  at 
least  31  samples  from  each  Input  waveform.  On  the  other  hand, 
with  a  lower  bound  for  p^Cl^)  one  can  make  statements  like — to 
achieve  the  specified  value  of  Pj(I^)  it  is  not  necessary  to  take 
more  than  43  samples  from  each  Input  waveform,  A  lower  bound  will 
result  In  over  designing  and  an  upper  bound  will  result  in  under 
designing  the  system. 
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The  probability  of  given  the  noisy  vaveform  is  the  j-th 
standard  waveform  is  an  upper  bound  for  for  ail  values  of 

1.  One  can  select  i  to  minimize  this  bound?  in  other  words,  the 
“best"  upper  bound  is 

min{  P^CE^jjj-th  stand. )»  stand.),  ...., 

PfCEjjj  I  j-th  stand.) 

— 5 

This  bound  is  easy  to  evaluate.  The  probability  of  E^^j  given  the 
noisy  waveform  is  the  j-th  standard  waveform  Is  equal  to  the.  pro- 
.babllity  that 

n  •  n 

I  ^  <=3  '  'I'E  '’>lp-'>3r><“3r*^^* 

r*i  j.=i 

The  left-hand  side,  of  this  inequality  is  a  normal -^random  variable 
with  mean  zero  and  variance 

r=is=i  . 

Hence  |  j-th  stand.)  equals  the  probability  a  normal  random 


variable  with  zero  mean  and  unit  variance  is  less  than 
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Let  represent;  this  constant.  Since  gives  an  upper 
bound  for  all  values  of  1,  the  "best"- upper  bound  is  obtained 
when  i  minimizes  If  the  noise  spectrum  has  a  sharp  high- 

frequency  cutoff,  and  if  lA  is  twice  this  cutoff  frequency, 


Note  that  is  the  ratio  of  the  mean  square  deviation  between 
Ujj,  and  Uj^j,  to  the  expected  square  deviation  of  the  noise  from 
its  mean.  In  Figure  1,  Pr(Ej^jjj-th  stand.)  is  graphed  against 
n  and  for  ^i^i  “  then  the 

value  of  i  that  minimizes  p^^  will  minimize 

The  probability  of  given  the  noisy  waveform  is  the 

J-th  standard  waveform  is  also  an  upper  bound  for  p^Cl^).  This 
bound  is  smaller  than  the  bound  derived  above,  but  it  is  also  more 
dlf^iciil't  to  evaluate.  The  probability  of  can  be  evaluated 

by  transforming  the  random  variables  to  a  standard  form  and  using 
tabulated  values  of  the  bivariate  normal  distribution. 


t  - . , 


Figure  1,  Graph  of  Pr(E..  j-th  stand 


V.  Preliminary  Re. lection 

If  the  number  of  standard  waveforms  N  Is  large,  it  is 

n 

awkward  to  select  the  value  of  1  that  maximizes  ^  ^Ir^ 


r=i 


The  selection  can  be  simplified  with  preliminary  rejection  of 

non-contenders.  If  c  )  b  x„  is  less  than  a  fixed  threshold 

1  ir  r  n  n 

t  ,  it  is  not  compared  to  c  +;  b„„x^,c„  +  /  '  b,  x^,  etc. 

1  ’  ^  a  Za  ;2r  r  ’  3  Li  'sr  r  ’ 

r-i  '  •  r=i 

It  is  easy  to  evaluate  the  probability  that  the  j-th  waveform  will 
be  rejected  erroneously,  l.e., 

n 


P'  f  =3  ^  I  ‘’3r='r  <  *3 


j-th  type  }  . 


r=i 

The  threshold  tj  Is  selected  so  that  probability  of  errnoneous 
rejection  is  "sufficiently”  small. 


